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ABSTRACT 

This journal issue summarizes the main points of a 
two-volume guide to youth performance management: "Working it Out: An 
Anthology of state and Local Performance Management strategies 
Designed to Increase Services to Youth at Risk of Chronic 
Unemployment. " The guide draws on the experiences of state and local 
practitioners in identifying specific ways in which states can expand 
and improve services to youth through such key state-level policy 
actions as selecting and setting performance standards, establishing 
incentive policies, increasing coordination among youth-serving 
agencies, making effective use of Job Training Partnership Act 
discretionary grants, and providing technical assistance. This 
summary also highlights best practices and policy guidance for the 
local level on issues such as definitions of at-risk youth and 
employability, development of multitiered service delivery systems, 
youth-centered competency-based program designs, contracting methods 
to encourage high performance, and effective use of requests for 
proposals. (KC) 
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In 1987, the U.S. Department of Labor (DOL) 
announced a series of fundamental policy goals 
that established improving the long-term 
employabihty of youth and adults as a clear 
priority for the Job Training Partnership Act For 
youth practitioners and policy makers, three 
goals were particularly important: 

• To increase services to individuals at risk of 
chronic unemployment, especially youth, 

• To foster training investments that lead to 
long term employabihty, 

• To increase basic skills training and 
competency -based occupational skills training. 

Taken together with a series of changes to the 
JTPA performance standar_ system for 1988-89, 
the Department's policy goaK present an 
imporlant opportunity and a challenge to state 
and local practitioners. By encouraging more 
intensive investments in services to youth, and 
by recognizing the importance of basic and 
occupational skills development through a new 
youth employabihty enhancement standard (and, 
in doing so, legitimizing non-employment 
outcomes for young people), the Department has 
set the stage for states and localities to change 
•he ways in which they serve at-risk youth 
under JTPA. Bui to make the bold and creative 
decisions needed to genuinely move the employ- 
ment and training system forward, states and 
SDAs need to know more about the performance 
management cptions that are available. 

This past winter, in response to the 
Department of Labor's youth policy initiatives, 
DOL's Chicago Regional Office created the 
Region V Youth Performance Management Task 
Force. Made up of experienced youth 
practitioners from state JTPA and education 
agencies, SDAs, PICs, and service provider 
organizations in Illinois, Indiana, Michigan, 
Minnesota, Ohio and Wisconsin, the Task 
Force's goal was lo identify policies and 



practices that states and localities could use to 
take full advantage of the new federal emphasis 
on i.nproving program quality and increasing 
services to those most at risk. Through a grant 
trom the Department of Labor, the Center for 
Human Resources at Brandeis joined the Task 
Force members in a six-month long effort to 
examine effective systems and program designs 
and to discuss the strengths and weaknesses of a 
variety of state and local policy options 

Working It Out 

The result of the Task Force's work is a two- 
volume guide to youth performance management 
Working It Out An Anthology of State and 
Local Performance Management Strategics 
Designed to Increase Services to Youth At Risk 
oj Chronic Unemployment Developed by 
Brandeis in partnership with the Region V 
Youth Performance Management Task Force, 
Working It Out draws on the experiences of 
state and local practitioners in identifying 
specific ways in which states can expand and 
improve services to youth through such key state 
level policy actions as selecting and setting 
performance standards, establishing incentive 
policies, increasing coordination among youth- 
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The Region V Task Force 

The Job Training Partnership Act continues to evolve as a tool 
for serving youth What began as a program focused almost 
entirely on employment has gradually shifted us emphasis towards 
long-term emploxuhility As a result, youth practitioners and 
policy makers are increasingly grappling with questions of how 
best to provide the basic educational, occupational, and substantive 
work skills thai at-risk youth need for success in the labor 
market. 

It is in this context that we believe the Region V Task Force 
and the Working It Out guide that resulted from it are exciting 
developments Firsu m looking at state and local performance 
management options, the Task Force and guide focus attention on 
the critical roles that >tatcs and SDAs play in determining the 
quantity and quality ot employment and education services for 
youth. It is through SDA decisions about who to serve and how, 
and through state actions on performance standards and incentives 
that federal goals are translated into programs and practices 
Second, the Region V Task Force also represents an important 
effort to build on the practical experience of working 
practitioners. It stands as a model for the kind of peer exchange 
thai tates and other regions max want to use to address issues 
ranging from effective basic skills progrumming to assessment 
practices to improving linkages between JTPA and schools 
Finally, the Task Force and Working It Out address tne issues of 
now to increase and improve services at a point in pme when it 
is clear that the emphasis on long-term employability and services 
to those most at risk is here to sta> Current DOL policies, the 
recent JTPA Advisory Committee report (Wot king Capital JTPA 
Investments fot the and most ot the propr>als for 

amendments to JTPA all point toward th<* need tor more 
intensive investments in building the long-term cmplovabihtv of at 
risk \outh We believe that the Task Force's work on 
performance management strategics can help the JTPA system 
move in that direction 

In the bnel space left, tv\o tnul notes The first is that what we 
have pnnteH here is onlv a partial version ot the Working It Out 
guide The full version contains additional charts, tables and 
notes The second, companion volume aK> contains a wealth ^ I 
sample policies and more in-depth discussions of specific issues 
We want to encourage readers to order both (Sec page 27 for 
information on ordering copies ) 

We also want to take this space to thank the Department of 
Labor and Joseph Juarez, the DOL Regional Administrator in 
Region V. for their support of the Task Force, and we especially 
want to thank the Task Force members (listed on the back cover) 
for tiieir energy and commitment in developing Working It Out 
Through their efforts, we have all learned how to serve at-risk 
youth a little better 
2 



Wan m$ It Out, continued from page I 
^ervinc agencies, making effective use of JTPA 
divcrehenary grants, and providing technical 
assistance. Based on options from SDAs and 
program operators i" Region V, the guide also 
provides Lest practu and policy guidance for 
the local level on such issues as definitions of 
at-risk youth ind employability, development of 
multi-tiered service delivery systems, youth- 
centered, competency-based program designs, 
contracting method , to encourage high 
performance, and effective use of RFPs. 

A Special Issue of Youth Programs 

In an effort to make the ideas and 
recommendations from the Region V Task Force 
widely available tc the JTPA community and to 
practitioners working in other youth-serving 
systems, we are devoting this issue of Youth 
Piogiums to presenting an abridged version of 
the Working It Out guide. The full version of 
the guide ;s available through the Department of 
Labor's ten Regional Offices, as is the guide's 
second volume, which includes examples of 
existing state and local performance management 
policies and a series of options p; pers developed 
by Task Force members that address specific 
performance management issues ip more depth. 

In presenting Working It Out, we need to 
repeat two points made in tl.e preface to the 
original guide. The first is that the title, 
"Working It O <t," was deliberately chosen to 
reflect the fact that the guide is essentially a 
work "in progress" While the options outlined 
by the Task Force represent the best judgement 
of experienced practitioners, we are all still 
trying out new strategies for helping young 
people, and it will be some time before we are 
sure how these options will work in different 
situations 

The second point is that Working if Out is 
designed as more than just a reference tool One 
ot the major themes of the guide and the whole 
Task Force process was the need for increased 
collaboration ~ between states and SDAs. SDAs 
and providers, and between JTPA and other 
youth-serving systems By clarifying policy 
options and highlighting some of the ways in 
which youth-serving systems could coordinate 
their services. Working It Out was conceived as 
means of encouraging that collaboration. It is 
our hope, and that of the Task Force, that in 
providing a common ground of information, this 
guide will spark a broader discussion among all 
practitioners of how youth agencies can work 
together to better serve those young people who 
are most at risk. 
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Starting With 
Youth At Risk 



skill and behavior requirements of employers and 
the diverse skills and behavior patterns of the 
youth population. The development of this 
supply and demand portrait may incorporate 
employer surveys, examination of "PIC 
recognized competencies," meetings with 
practitioners and youth, and reviews of statistical 
data and other sources. What is important, 
however, is that the needs of youth and 
employers set the context for answering three 
fundamental performance management questions 

• Whc are you going to serve'* 

• What outcomes do you want to achieve' 

• What traming and service needs have 
to be met? 

This guide begins with the as>umption that the 
"who" we all want to serve are at-risk youth - 
loosely defined as those youth most likely to 
fail in school and the labor market - and that 
the outcome we want to achieve is long-term 
employability. In this section, we will outline 
some cf the issues involved in refining thai 
definition of "at-risk youth" and in making 
decisions about outcomes and service op'rons, 
based on the discussions of the Region V Task 
Force. The answers to these questions are 
important. It is through them that we begin to 
determine the kinds of program designs that are 
most opropnate for at-risk youth and the 
policies needed to support an effective high 
performance youth training system. And in doing 
that, we set the goals for performance 
management at both the state and local levels. 

Who Are You Going To Serve? 

There are a number of methods for defining at- 
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risk youth, and as many specific definitions as 
there are practitioners Each approach carries 
implications for measuring performance and 
designing systems and programs 

Group Characteristics. The most traditional 
way of defining the at-risk population (and 
perhaps the most popular under JTPA) is in 
terms of demographic characteristics. Practitioners 
have long known that low income, being black 
or hispanic, having dropped out of school, 01 
receiving welfare, among other fa-tors, correlate 
highly with risk of long-term unemployment. 
More recently, behavioral characteristics such as 
court-invoKement, teen parenting and substance 
abuse have been identified as additional risk 
factors. At-nsk youth, then, are frequently 
defined in terms of a list of characteristics, or 
combinations of characteristics. 

Many states and communities depend 
exclusively on these kini> of demographic 
indicators to define the at-risk population, 1.1 part 
because of the strong research base, but also 
because the data are readily available through 
the census and other public documents There 
are, however, several significant drawbacks o 
using only group characteristics to define the 
youth population. The first is that as proxic for 
more specific skill deficits and social problems, 
group characteristics are not easily compared to 
employer requirements in defining employability, 
nor can they be readily translated into needs 
that can guide a service strategy. As a result, 
when used in planning, they lend to mask the 
real skill issues that need to be addressed Th: 
second drawback is that the use of group 
characteristic as a performance management 
strategy does not guarantee that all youth in th it 
group are at-risk Minority youth, as one 
example, will vary substantially in their levels tl 
skill and experience, but all may be included in 
an "at-risk" strategy In fact the "creaming" 
charges often leveled at JTPA programs arise, in 
part, because all members of a target group 
served by JTPA may not necessarily have 
emplo>ment-reIated skills deficits or other 
barrier* to employment. 

Skill Le\els. A second approach that is 
growing in use is the definition of at-risk youth 
in terms of specific skill deficits or levels of 
employability. In this instance, at-risk youth are 
often defined as those lacking functional basic 
skills and/oi pre- employment/work maturity 
skills This approach focuses much more 
specifically on skills (such as the ability to read 
a graph or to complete a job application) which 
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Most works on performance management begin 
with a statement about JTPA\s performance 
standards and the roles that state and local 
policy makers can play m a performance-driven 
system. But effective performance management 
(and effective programming) begins not with the 
legislation or the regulations, but with thinking 
about what it means to build the employability 
skills of at-risk youth. Whether establishing 
statewide goals or designing a local program 
mix, policy maker* and planners need to begin 
their thinking by looking at the fundamental 



can be matched up more directly with employer 
expectations. Equally important, by defining at- 
risk youth in terms of specific skill levels, 
practitioners are also able to recogni/e and 
define different levels of need within the youth 
population in very specific terms - such as 
youth testing above or below specified reading 
and math levels. As a result, planning decisions 
can be made with more precision, and program 
providers can develop appropriate curriculum and 
program designs for meeting different levels of 
need within the population 

Several points need to be considered m 
adopting a skills-based definition The skills 
approach to defining at risk youth requires the 
development or procurement ot new data sources 
(such as academic records) and assessment tools 
to gather planning data that indicates skill levels 
- activities which are beneficial in the long-run 
but may be time consuming and expensive in 
the short term. Some practitioners argue that a 
purely skill-based definition tails to take into 
account important social and cultural barriers to 
employment Finally . areas that have traditionally 
defined service in terms ot demographic groups 
only may find it politically difficult to make the 
shift to an exclusive ski II -based definition 
because it appears to reduce the focus on 
particulai target populations. 

The Preferred Approach: A Hybrid Definition 
to Increase Service to At-Kisk Youth The 

Task Force formulated a third approach which 
combines both skill measures (such as basic skill 
level) and ? r >up characteristics (such as teen 
parent) in defining at-nsk youth. A "hybrid" 
definition, tor example, mighi define at-risk 
youth as those who are dropouts, or minorities, 
or teen parents and who lack specific 
educational and/or work skills The purpose ot a 
hybrid definition is to gain the advantages of 
the skill approach - that is. targeting those 
with clearly specified employment skill needs - 
while formally recogni/mg some ot the social 
factors that exacerbate the risks ot failure in the 
labor market. By including demographic and/or 
social characteristics, the hvbrid aoproach may 
also make it easier for "PA and other youth 
serving agencies to develop common definitions. 

What Outcomes Do 
You Want To Achieve? 

Most practitioners agree the ultimate outcome tor 
youth in training and employability cevelopment 
programs should be "to attain economic self- 
sufficiency through employment". In effect. 
quality employment is the best final outcome for 



training and the goal towards which all young 
people must move. 

However, any discussion of outcomes for 
youth also has to go beyond the simple slogan 
"our job is jobs" and recognize that for many 
youth - those requiring long term, intensive 
basic skills remediation and workplace training 
- it is essential to identity interim outcomes on 
the road to employability. All young people are 
not alike, and an effective employment and 
training strategy has to recognize the different 
levels of need among youth and to establish 
interim and final outcomes that are appiopnate 
to the profile of the youth that are enrolled. For 
some youth, immediate employment is not only 
possible but appropriate and desirable. For 
others, some exposure to the world of work may 
be necessary prior to placement, and for still 
others extensive training, counseling and rigorous 
work site training will be required prior to 
quality placement. For every youth, though. 
"How long it takes to reach the level of 
employability (e.g. job readiness) depends on 
where you start." 

In developing a coherent strategy for serving 
youth, then, practitioners and policy makers need 
to define interim as well as final outcomes that 
are meaningful, that are related to a youth's 
initial level of skill, and that reflect real 
progress toward employability For those youth 
needing intensive training and basic skills 
developent. employability skills development as 
measured by "competency attainment" under 
J TP A can be a logical interim outcome For 
other youth, employment may be the only 
outcome that reflects real gains. What is 
important, however, is that there is a sequence 
of outcomes that enable young people to be ade- 
quately prepared before they are placed in a job. 

What Training And Service 
Needs Have To Be Met? 

It is now common knowledge among 
employment and training professionals - the 
Work Force 20(H) forecasts, the Quality Work 
Force Initiatives and reports on "The Forgotten 
Half have succeeded in raising our 
consciousness - that the problem is not a 
shortage ot workers overall, it's how those 
workers fit or do not fit the available jobs. The 
"mismatch" between workers and skill demands 
is attributed largely to a demographic shift in 
the population anj growing technical 
sophistication and skill requirements of the labor 
market. In short, there are fewer prepared entry 
level workers for jobs requiring higher order 
cognitive and workplace skills. 
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Addressing the Mismatch Between Needs 
and Available Services. Many experienced 
employment and training practitioners and policv 
makers recognize yet another great mismatch - 
one between their client groups and their JTPA 
program designs. Demographics certainly help 
explain part of the problem. While the actual 
number of young people entering school, training 
systems ana the labor market is diminishing, the 
proporion of those suffering from poverty, lack 
of education, run-ins with the law. language 
barriers, etc , is actually increasing. These are 
the young people for whom we are designing 
special "high risk" programs. There is another 
element exacerbating the mismatch between 
clients and piOgram designs. As the economy 
continues to improve and sustains an "employees 
market." more of the youngsters characterized as 
"employable" or "nearly employable" but 
requiring effective short-term job search training 
(typical of JTPA training regimes) are getting 
jobs on their own. Often "job-hopping" - 
moving easily from one job to another - and 
occasionally taking a moratorium from work, 
these youngsters are confident the next job will 
be waiting for them. To be sure, there are 
training and quality career issues associated with 
this behavior, but for the employment and 
training professionals the immediate (and perhaps 
lasting) consequence of these labor market 
dynamics is that - on a continuum of 
employability preparation - those nearl> read) 
for work and those needing placement services 
are harder and harder to find. Yet. most JTPA 
programs have been designed around those \cr\ 
youth. 

Responding creatively to the new 
demographics and the labor market demand is 
the performance management challenge ot the 
1990s and requires a new look at how our 
employment training systems are structured. 
Practitioners are currently reporting the need for 
more capacity to serve the handicapped and 
youth severely lacking in basic education skills 
and prc-employment/work maturity skills And as 
the section on local strategies indicates. JTPA 
administrators will increasingly need to develop 
strategies that can address multiple levels ot 
needs, that can match services and individual 
needs, and that can support a long-term 
employability devclopmeni process 

Implications For 
Performance Management 

Meeting the needs of at-risk youth toda> means 
changing the current way of doing business 



Rather than simply continuing with programs 
that have been successful in the past, policy 
makers and practitioners are going to iiave to 
look closely at the needs of youth, the demands 
of the labor market, and the services currently 
available and be^in moving to fill some growing 
gaps More and more, both state and local 
administrators need to ask* Given the skills, 
experience and support that young people need 
to achieve employability (and ultimately 
employment), what kinds .if services do we need 
to offer to whom, what kind of program mix do 
we need, what institutions should we bring into 
the service delivery process, and how do we 
provide incentives to encourage agencies to 
provide increased services for youth at risk'* 

Building a System Based on the Needs of 
Youth The implications of these questions for 
program design and performance management are 
signficant By beginning with the needs of youth 
and the demands ot the labor market we can 
develop employability development strategies that 
are relevant and responsive. As we struggle with 
the difficult issues of defining "at-risk youth" or 
of identifying appropriate interim and final 
outcomes, we can begin to sec what kinds of 
services we need to be providing and how they 
can be most effectively organized. And as we 
build a service delivery system based on the 
needs of young people, we can also begin to 
sec how we can use state and local performance 
management tools to support the employability 
process 

Finally, as JTPA serves larger proportions ot 
youth with multiple needs who require a 
combination of education, employment and social 
services, it becomes increasingly clear that JTPA 
can not go it alone Interagency cooperation has 
never been more important. JTPA professionals 
must determine what share of the job ot 
p r eparing youth people tor sell -sufficiency makes 
sense for them ami. more to the point, how that 
share can succeed within the current performance 
management system. But. as we will say main 
times in the course of this guide, one ot the 
most consistent themes ot the Region V Task 
Force was the need tor all of the agencies 
involved in serving youth to develop a holistic 
mcw ot the interagency vouth preparatory 
system There is no question that we collectively 
must strengthen basic education skills, workplace 
skills and support services for at-risk youth It is 
also clear that there is no time to debate whose 
job it is The challenge is bigger than any one 
agent 
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Local Strategies: 
Program Design 
and Performance 
Management 

Most experienced practitioners agree on the basic 
elements of effective programming for at-risk 
youth. A mix of work and classroom learning: 
an individualized, competency based approach 
based on an assessment of individual needs and 
a mutually agreed upon employabili'y 
development plan, the close supervision of a 
competent, caring adult: and a case managed 
approach that provides access to a range of 
supports and services are some of the elements 
that emerge time and agair from Task Force 
discussions, practitioner roundtables and research 
reports. While specific progiam designs vary in 
the focus and intensity of these services, the 
basic elements of effecive youth programs are 
familiar and present to at lea^ some degree in 
almost every Service Delivery Area 

As the opening section of this guide suggests, 
the real challenge for practitioners today is not 
that of determining what kinds of services are 
effective, but one of how to structure, manage 
and finance a system of services thai can build 
the employabiht) skills not only of those youth 
who are nearly job ready, but of those who are 
most at-risk. Performance management at the 
local level, then, is the process of moving the 
local service delivery structure from what is 
often a one dimensional collection of free- 
standing programs towards an integrated and 
comprehensive youth serving system 

This section provides an introduction to three 
critical elements of effective local system design 
nd performance management: the concept of a 
. ilti-tiered service delivery structure, a 
competency based approach to training, and the 
use of performance-based contracting in 
financing longer term, intensive training and 
education. What is presented is explicitly an 
itittodmtum we do not pretend to provide a 
comprehensive technical assistance guide. There 
are too many details and local variations to do 
that here We also need to be clear that, in 
discussing these local strategics, perhaps more 
than in the section on state performance 
management options, we are covering new 
ground. While none of the concepts are new, 
the JTPA system in Region V and elsewhere is 



just beginning to work out their practical 
application. Our goal, in that context, is to 
introduce some basic options and ideas on how 
services can be organized at the local level to 
create new opportunities and incentives to 
increase services to at-risk youth. It is our 
hope that they will spark new effort: that will 
help us all bring them into daily operation. 

Building a System 

to Meet Multiple Needs 

What are the basic criteria for an effective youth 
system? A recent review of dropout prevention 
strategies reminds us that "no single approach or 
strategy will prove effective for all children and 
adolescents in difficulty." 

What works for a pregnant dropout or teenage 
mother may not meet the needs of an adolescent 
who leaves .school to take a job Similarly, a 
youngster who has performed fairly well in 
si hool hut whose family life is in disarray may 
require different support and guidance than 
[another J who has fallen far behind his grade 
level Youngsters in tumble in school and at 
the workplace do not constitute an undiffer- 
entiated mass Therefore, efforts to intervene on 
their behalf must respond to their distinct and 
vatied need. [Dropouts in America Enough is 
Known for Action) 

To meet the needs of at-risk youth effectively, 
then, a service delivery system must be able to 
respond to the differences among youth. It 
must be able to address multiple needs and the 
increasingly significant skills deficits that 
characterize youth at risk. Above ail, 11 mw 
be "kid conscious," 'is one of the Task Force 
papers notes, growing out of the needs of the 
young people served rather than arbitrary 
program regulations or performance standards. 
Based on the Task Force discussions, tour 
tunaamenta! elements are required* 

• a program mix that is flexible and vatied 
enough to address a spectrum of individual 
needs and skill levels and that has the means 
(through assessment) to identify those needs; 

• the capacity to provide intensive and long 
teim pi ogt amming. with appropriate interim 
outcomes, for those youth with the greatest 
deficiencies: 

• an integrated and collaborative approach that 
can provide an array of services, in particular a 
mix of remediation and work experience; 
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• a graduated sequence of servues that extend 
over time, combining, for example, school-year 
and summer programming over several years, to 
provide for the development of a hierarchy of 
skills and experience. 

The Multi-Tiered Approach: 
Matching Kids and Services 

The need to be able to provide a mix of 
services matched to the needs of different youth 
and a sequence of services that can address the 
need for long-term, intensive programming for 
some youth is leading more and more 
practitioners toward the development of a multi- 
tiered service delivery system. Where the 
traditional JTPA service delivery system is often 
organized as a collection of categorically targeted 
and funded programs (such as programs for 
minority youth or pregnant and parenting teens), 
a multi-tiered approach is organ^ed in terms of 
the employability skills of the youth being 
served, with each "tier" representing a sequence 
of programs and services designed to address a 
particular level of needs 

In Region V and elsewhere around the 
country, one multi-tiered approach model is 
being developed that is based on the definition 
of three broad skill levels or levels of need 
among youth: 



• Employable* those who have solid basic and 
work skills, but need a job connection; 

• Nearly Employable needs some basic 
educational skills, pre-employment and work 
maturity skills, and on-the-job training; 

• Pre-emplcyable. need intensive basic education 
and work site training. ^ 

In the three-tiered model, services are then 
aligned with the skill needs of the three groups 
of youth being served, with a different set of 
services for those youth functioning at each 
level. Youth entering the system at any one of 
the levels can continue upward through the skill 
hierarchy until they are job ready. The table 
below illustrates how a three-tiered approach 
provides a structure to match youth with an 
array of employment-related services. 

A Systematic Approach to Employability 

The strength of the multi-tiered strategy lies in 
its systematic approach to matching services to 
individual needs and its provision of a clear 
progression or sequence of services leading from 
the development of fundamental basic skills to 
employability. Using ongoing assessment and a 
competency based approach to programming, the 



THREE-TIERED YOUTH DEVELOPMENT MODEL 



Tier 



Tier 1 

Employable (Advanced) 



Tier 2 

Nearly Employable 
(Intermediate) 



Tier 3 

Pre- Em ploy able i Basic) 
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Sample Services 



Career Awareness 
Job Search Assisunce 
Placement 



Pre-Empio) merit Skills 
Training 

Try out Employment or On- 
the-Job Training 
Basic Education Tutorials 
within schools and in 
alternative settings 



Intensive Work Site Training 
w /competent adult as 
supervisor, guide, mentor 
( Behavior/Attitudes. Work 
Maturity) 

Employment Related Basic 
Skills Remediation 
Counseling/Coaching 



JTPA Program/Source 



Conventional Title 1I-A 
"hast Track 



JTPA Menu * 
Title II A and B, 
Hght Percent 



Entry Employment 

Experience 

Title II A and B, 

Eight Pencnt Set- Aside 



Sample of Partnership 
Help Needed 

JIPA-Labor Market 
Exchange 
Private Sector 

Hnployment competency 

ccrtitica'ion 

Quality placements 

Education 

Trained remediation 
instructors 

Cumculum (level for YEC 

Private Sector 

Quality worksites for training 

Effective supervision 

Employment competency 

certification 

Social Service 

Enhanced counseling capacity 
(lannly. drug abuse eic I 
Transportation Curriculum 
devel for YEC 
Education 
Trained remediation 
instructors for in school and 
out f school 
Functional cumculum 
development for YEC 
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multi-tiered system offers flexibility and variety 
in the program mix, provides the capacity for 
longer-term programming, incorporates a mix of 
work and basic educational skills for those who 
need it, and organizes those services into a 
logical employ-ability development sequence. 

The other strength of the multi-tiered strategy 
lies m the practical solution > it offers to the 
problem of ^-oviding the longer term, intensive 
(and expensive) services for those youth needing 
substantial remediation under JTPA. By manag- 
ing the mix of youth served and balancing the 
higher cost Tier 3 interventions with lower cost 
Tier I services, SDAs can maintain the kinds of 
cost averages ?nd terminations that allow them 
to work with those most in need while still 
meeting JTPA performance standards. In that 
context, the multi-tiered approach stands not only 
as a.i effective programming strategy, but also as 
a sophisticated financnl management device 

Flexibility in Service Delivery Within a 
multi-tiered framework. Service Delivery Areas 
have substantial flexibility in the *vay services 
are actually delivered. SDAs may choose to 
contract the entire array of services, both work 
and education, to the local schools or to h<*ve 
them delivered through a combination of schools, 
the SDA and community-based organizations 
{CBOs), with schools providing the educational 
services and CBOs and the SDA operating the 
work skills training. SDAs could also operate 
all the programs "in house" by developing their 
own educational components. A single 
contractor may elect to provide the full range of 
services, from Tier 3 up through Tier 1; other 
contractors may focus on providing services 
within a single tier What is important on the 
service level is that the progression of services 
is available and that youth are able to move 
from one level to the next as their skills 
develop 

Whatever delivery mode is right for your 
community, it ■ important to keep in mind that 
balancing interim and final outcomes and 
mtasuring-up in terms of performance standards 
will require increased management time. As one 
Task Force member put it, the multi -tiered 
approach depends on an astute "management of 
terminations" or "balancing of enhancement and 
entered employment rates" in order to meet 
performance standards. Even with this 
perception intact, however, the value added to 
the delivery system is thought by man) to 
outweigh the management burden. The 
development of a multi-tiered system offers an 
unparalleled opportunity for Service Delivery 



Areas to work with their contract providers and 
with partner agencies in the community to 
define youth needs clearly and to build a system 
that is truly "youth-centered" Without that 
effort, we are likely to face a growing labor 
market and training "mismatch" and a continuing 
crisis in our ability to build youth employabihty. 

Addressing Individual Needs: A Rationale 
for Competency Based Training 

Multi-tiered systems offer a strategy for 
structuring local programs to provide the range 
of services needed to meet the needs of a 
diverse youth population. But the capacity to 
match programs to the needs of individual youth 
and to provide a structured sequence of 
employabihty development also depends on 
having a system that can clearly identify the 
specific skills that a young person needs to gain, 
that can teach those skills n a practical context, 
and that can measure and document gams as 
they take place. Competency based training 
provides that system and, when properly 
designed and undertaken, offers practitioners one 
of the most powerful performance management 
tools in the employment and training repertoire. 

Few areas of youth programming are more 
misunderstood, misrepresented or underutilized 
than competency based training under JTPA. 
For many JTPA practitioners, "youth 
competencies" refers only to a seemingly arcane 
set of regulations governing the reporting of 
positive terminations. But, in fact, competency 
based training grows out of a simple set of 
ideas long at the heart of vocational tiaming: 
teach people what they need to know and 
enable them to learn (and be tested) Dy having 
them do it In a competency based program, 
learning is defined in terms of specific, clearly 
defined skills or learning objectives, with a 
young person's progress measured by his or her 
demonstrated mastery of successive skills. 
Instinct ion einph- sizes real world applications, is 
self-paced and focused on the specific skills a 
participant needs to learn, with regular and 
frequent feedback as the mdi/idual completes 
each task or lesson An ongoing sequence of 
assessment, goal setting, institution, and 
evaluation allows students and instructors to 
identify needs and measure progress towards 
employabihty 

An Effective Teaching Strategy. Experienced 
practitioners and researchers seem to agree that 
competency based training is effective with 
youth at risk for several reasons: 
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• it stresses shared responsibility for learning. 

• it involves a competent, caring adult role 
model as teacher. 

• it is based on life experience (work situations, 
for example) and emphasizes practical content as 
the basis for learning and testing, and 

• it stresses application and integration of 
knowledge for immediate use. 

Finally, competency based training sets clear and 
achievable goals for young people and enables 
them to gain a sense of real progress and 
achievement. As such, it provides a critical 
degree of reinforcement and motivation for youth 
in employment and education programs 

A Learning Management Tool. On the 

systems level, a competency based approach 
offers equally significant benefits In the 
context of a multi-tiered service delivery 
structure, a competency based approach provides 
the framework that allows practitioners to match 
services to needs and measure progress through 
the system. By identifying a hierarchy and 
sequence of skills necessary for employability. a 
well-defined system of employability 
competencies makes it possible to determine at 
what level a youth should enter the system, to 
set reasonable individual goals; to objects ely 
measure gains; and to legitimately rewan 
achievement. "Youth competencies" in tnis 
context means much more than the provision of 
a separate "competencies program" for selected 
groups of youth. Rather it is the development 
of a systematic approach to youth development 
that is applied 'o all of an SDA's youth 
employment and education programs. 

Connecting Youth and the Labor Market. 

Lastly, a competency based approach to training, 
by focusing on what youth need to know to be 
employable, enables youth practitioners to make 
a clear connection between what youth ^e 
learning and the demands of the workplace 
The best local systems are truly based on 
employer hiring standards, and therefore ensure 
that young people are developing the skills 
needed to gain a job and to retain a job Task 
Force members also point out that business 
leaders have a clear preference for measurable 
results. As such, a competency based approach 
is often favored by private sector partners and 
Private Industry Councils because it "promotes 
accountability and an economy of means" and 
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because of its capacity to clearly identify the 
outcomes of training and the skills that young 
people would bnrg to the workplace. In short, 
the development of a competency based system 
provides not only use.ul program and 
management tools, but an invaluable tool for 
marketing training graduates in the labor market. 

Making Youth Competencies an 
Effective Management Tool, Not 
a Bureaucratic Nightmare 

To be used as an effective performance 
management tool, a competency based training 
system has to reflect a commitment to integrated 
and systematic planning, implementation, and 
evaluation of the educational and employment 
training processes. Competency based training is 
a total program that integrates curruulunu 
instruction and assessment and that requires 
management, counseling, worksite, and 
instructional staff to work closely together as a 
team to clearly specify what is to be learned, 
how it will be measured and how instructional 
materials will be tocused on the 
learning/management objective. It is when 
competency programs are designed as separate 
"activities" with little purpose beyond insuring 
positive terminations that the burdens of 
assessment, testing and documentation become 
overwhelming. 

The "Elements" in a System Context: A 
Simplified View It is in .he context of a 
"system" approach that JTPA's requirements lor 
a "sufficiently developed system" begin to appear 
less arbitrary and threatening for practitioners. 
In a competency based system, the linkages 
among curriculum, instruction and assessment 
provide a method to plan and manage a well 
integrated employability development program. 
The "PIC-reeogni/ed competency statements" 
identity the goals and objectives of the 
competency system; they provide an outline ot 
the skills that need to be taught as a young 
person move^ along the employability 
continuum. Carefully designed stages and types 
of assessmen' in a sufficiently developed system 
serve several purposes. An initial "appraisal" 
provides data to indicate the most appropriate 
program level for youth (i.e. in the ihree tiered 
model an appraisal would effectively "sort" 
youth into three levels of employability. Pre- 
and post-tests, as well as regular benchmarking, 
enable instructors to systematically monitor the 
progress of individuals (and groups) in ordei to 
determine when youth are ready to move to 
more advanced curriculum levels They also 
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enable program operators to certify mastery of a 
specified level of proficiency or "attainment of 
youth employment competencies." The curricula 
indicate how needed skills will be taught and 
must, logicall), relate to old teach the 
competencies that need to be attained The 
employability development plan provides a 
means of documenting assessment results and 
insuring that participants are assigned to 
activities related to their skill development needs, 
and certification - a "diploma" or skills 
passport" - provides a means of indicating to 
participant and employers that a specific set of 
skills has been gained 

Competency Based Systems as a Process . 

The effectiveness of a competency based system 
depends not only on having the necessary 
elements, but also on the development process. 
According to Stiles and Tibbits, two highly 
regarded experts in competency based training, 
the development of an effective system requires 
several ordered steps Those include. 

• development of a philosophy statement that 
reflects a competency based program (as 
contrasted with a conventional program). 

• selection of competencies specific to the needs 
of local agencies and communities (Implicit in 
this is the neet J for a labor market assessment 

as well as assessment of instK Clonal staff and 
participants ) 

• a system to share with participants the 
jgencVs competency goals so that participants 
can select, add to, and prioritize their own 
employment objectives. Youth sometimes go 
through entire programs *vith only vague 
understanding of expectations. Even worse, 
these expectations may appear to be unrelated to 
participant goals. Clear and open 
communication between agency staff and 
participants can help avoid dissatisfaction and 
drop-out resulting from miscommunication and 
frustration about student goal attainment. 

• development of an educational/emplo) ment 
sequence based on selected competencies. It is 
the responsibility of management to see that 
competency based course outlh.es are written 
and correlated with appropriate curriculum 
materials. 

• provisions made for on going staff 
developnent activiPes to insure that the above 



operations are fully-functioning and not mere 
"paper operations. 

• development of a systematic program 
evaluation process that is competency based and 
widely publicized. The purposes of evaluation 
must be made known to staff. As wiih other 
aspects of competency based training, the 
emphasis is always on the participants and the 
program benefits Ihey derive. Results from 
program evaluation bdp decision-makers modify 
the participant's program when and where 
necessary. Evaluations should identify the 
benefits that are gained, their relative costs, and 
determine whether more benefits could be gained 
for the same relative costs, or if the same 
benefits could be had for lower relative costs. 

In summary, a competency based "system" 
implies a curriculum management approach that 
wiil only work to increase quality services to at- 
risk youth if it is designed as a coherent system 
benefiting youth, staff and employers. Stiles 
and Tibbits caution local administrators about the 
importance of establishing systems through a 
collaborative approach. If competency based 
training is to be successful, they say, all staff 
neen to be involved at each step in the 
development anc' operations of the programs. 
This is a point t» at Task Force also reinforced. 
For competency based programming to increase 
and improve services to at-risk youth, it must be 
developed in conjunction with those partner 
agencies likely to >hare in the training process 
(particularly education) as well as with service 
providers 

While the development of an effective 
competency based system is a time consuming 
and demanding process, it has tremendous payoff 
in terms of the ability to link programs in a 
coherent sequence and to move young people 
through an ordered employability development 
process. The "bureaucratic nightmare" of youth 
employment competencies comes when they are 
developed as a special activity designed solely 
"to meet performance standards." It is when 
competencies are taken out of the context of 
effective program and system design so that the 
paper requirements are many and the benefits 
few, that competencies become unsuccessful not 
only as a toe for administrators, but as a 
system for serving at-risk youth. 

Competencies 2nd System Change 

When linked together, the development of a 
coherent competency based system and a multi- 
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tiered service delivery model provide a powerful 
catalyst for changing the way in which at nsk 
youth are served on the local level. In defining 
a set of competencies that address the needs and 
expectations of employers and in organizing 
services to reflect the differing levels of skills 
among at-nsk youth, local practitioners and 
policy makers have an opportunity to rethink 
who they should be serving, what kinds of 
outcomes are appropriate for which youth, what 
kinds of services need to be provided and who 
needs to be invoh :d. That process can lead to 
thi development ot new collaborative 
relationships between SDAs, employers, partner 
agencies and services providers; to a better 
understanding of what constitutes an appropriate 
gain or "positive termination'' point for youth 
entering the system at different levels; and to 
the design of programs and services that more 
accurately match the needs of at-nsk youth and 
the labor market. Once established, a well- 
designed competency system also provides the 
means for continually monitoring and evaluating 
the operation of local programs and the system 
as a whole, providing a constant flow of 
assessment data on the needs of young people 
as they enter the system as well as data on the 
success of individual programs in building the 
skills of program participants. The result over 
time will be a system that, perhaps for the first 
time, provides the tools needed for local 
practitioners to truly manage local performance 
in a way that will improve and expand services 
to at-risk youth. 

Making It Work: 
Financing Youth Programs 

Enabling contractors to provide qualnv training 
to at-risk youth requires change at every level 
of the employment and training system, Not the 
lea^t of these changes is in how we finance 
programs within a multi-level service strategy. 
For SDA administrators, taking on the next 
generation of challenges as presented in this 
paper not only demands astute "terminations 
management." (i e.. balancing how many 
enhancements and how many entered 
employment outcomes you can afford under >our 
performance standards), but it requires a 
financial strategy that offers service providers 
incentives to develop the programs needed to 
address the . ;eds of those youth most at risk 
There are two basic methods for paying for 
employment anJ training services today, one 
traditional, and one somewhat controversial and 
creative. Many agencies and school districts are 



successfully funding youth programs through 
traditional cost reimbursement contracts. This is 
in most cases a simple, direct and familiar 
approach, but one that emphasizes predictability 
of cash flow over accountabihty. Other SDAs 
and PICs are experimenting with innovative - 
even revolutionary - performance based, or 
hybrid contracts that attempt to balance a 
demand for accountability with incentives to 
those youtn most in need of assistance. This 
section briefly outlines some of the key concepts 
tp1 principles underlying the development of 
l- .se new performance based contracts and how 
this tool can be used to increase services to at 
risk youth by providing incentives for contractors 
to take on the "riskiness" of doing business with 
hard to find" and "hard to serve" young people 

Five Contracting Principles As practitioners 
and policy makers have begun to consider how 
to use performance-based contracts to encourage 
increased services to at-risk youth, they have 
identified five elements to guide the contracting 
process. An effective contract, they have 
suggested. 

• is developed around the key accountability 
principle "get what you pay for anil pay for 
what you get " In other words, the costs in a 
contract should vary with the difficulty and the 
length of time involved in the task, hi the case 
of a contract in a multi-tiered system, costs 
would vary with the level of employabihty ol 
the entenng youth and his or her need for 
support services 

• employs payment benchmarks that are 
measurable and achievable. 

• share> the risk of serving high-risk youth by 
pa\ing for time spent and tor achievement of 
benchmarks. We need to acknowledge thai as 
we attempt to increase the proportion ot high 
risk youth in our mix of participants, we 
simultaneously increase the contractor's risk ot 
failure. It becomes necessary, therefore, to build 
in some incentives and safeguards tor the 
contractor (this is especially relevant for h>bnd 
contracts that are at once performance based and 
cost reimbursement). 

• seeks to recogni/e and reward youth 
participants for learning gains by providing 
"learning reinforcement payments" for progress 

• motivates contractors to increase services io r 
high risk youth 
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Two Multi-Tiered Contract Models The 

fierform, ice-based contracting models being 
developed in Michigan, Los Angeles and 
e\ewhere begin to suggest some of the ways in 

' .ch these general principle;: can be carriec' 
oat. By combining performance based contract 
with the three tiered service delivery model, 
both the Michigan and LA models have 
provided a mechanism, based on clear and 
measurable standards, for varyng payments 
according to the f ypes of services needed and 
the difficulty of the task. By tying payment 
structure to participant assessments, those SDAs 
have developed an objective means of 
determining the level of participant needs and 
the type of investment service providers are 
IikHv *o have to make. Similarly, the use of a 
fully developed, hierarchical competency ba>ed 
system in those SDAs enab s them to establish 
payment benchmarks that are measura>le and 
provide for a high degree of accountably .in*' 
quality control. 

Performance based contracts a!* ? provide a 
number of mechanisms for sharing risks. In a 
strict performance based contract, there is an 
opportunity to do this by paying for a portion 
of the "time" sper.l developing skills in addition 
to "competency attainment" or placement. In a 
hybrid approach, you can assure the contractoi 
some cash flow capacity by coupling that 
strategy with a cost reimbursement approach for 
support serv.ces. The contract model developed 
by the City of Los Angeles represents a 
particularly sophisticated incentives strategy for 
services to high risk youth r encouraging 

quality outcomes. With tV,u milestones 
established for vested earn.ngs purposes, the 
costs vary according to the employ ability status 
of the participant. ' The categories for payment 
points include: 

1 Complete Initial Training Objective 

2 Employment Enhancement 

3 Placement 

4 Placement Quality Measures 

The city encourages contractors to bring pre- 
employable youth all the way to the level of 
employability by » awarding competency 
attainment at specnied intervals in both basic 
skills and pre-employment work maturity. While 



'More detailed materials on the LA model and models beinc 
developed in Michigan can he tound m the full \ersion o! 
Working It Out Also, piease note that ihe Citv oi Los 
Angeles has continued to revise its model since the initial 
publication of tootkmx It Out 



the contract awards competency achievement, it 
also pa>s contractors for time invested in skill 
building - but with a cap if no progress has 
been made within a certain time period. 
Contractors, therefore, know tha* they will be 
paid for the extra time they invest in working 
with youth • ceding intensive remediation, 
provided that the investment results in reasonable 
gams. Provisions for earning payments at ail 
four milestones make it possible for contractors 
to earn up to $10,000 for the most intensive, 
high quality services to at risk youth. 

It is worth noting that the LA contract also 
provides for "learning reinforcement payments" 
for direct payment to participants each time a 
gain is achieved, thus making it possible for the 
contractor to establish incentives for participants 
as partners in the learning prr .ess. Finally, the 
Los Angeles contract model weights the 
paymer's according to the skill needs of the 
youth on entering the program. As a result, 
contractors serving those most at risk are 
rewarded more substantially for basic skills gains 
than for placement, again providing an incentive 
for investing in skills development and 
recognizing the extra level of intensity required, 
while the payments for those youth who are 
almost job ready are more heavily weighted 
toward placement. The result is a system aimed 
an encouraging appropriate services rather than 
pushing for tne same service for every youth 
regardless of need. 

A Joint Learning Process In presenting these 
models as options for local consideration, two 
points have to be made. The first is that these 
contracts, once again, represent the leading edge 
of local practice. As pilot efforts to work out 
new ideas, they are only beginning to be tested 
in practice, htence, while the principles are well- 
established, both the Michigan and Los Angeles 
models will undoubtedly need to be refined in 
practice, and as other localities move in similar 
directions, the details of these or similar models 
will need to be adjusted to meet local needs 
and expectations. 

The second point flows from the first. 
Because we arc learning as we go along about 
how to use contracting as a tool for improved 
and expanded service to youth, this type of 
contracting - like the other elements of youth 
system design - will only work if developed 
collaboratively. As one of the Task Force 
options papers from Michigan persuasively 
argues, SDA administrators, partner agencies, and 
service providers need to work together from the 
beginning to define goals, to identify risks and 
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negotiate ways of compensating for them, and to 
develop mutually agreeable systems of paymert 
points and relative payment weights, h is 
ultimately through the RFP and contracting 
process that the guidelines governing program 
design and service delivery at the local level all 
come together. If we are to develop a system 
that can effectively serve the needs of all youth, 
that system must be collaboratively designed. 

Conclusion 

The performance management challenge for the 
1990s - matching programs and services to the 
needs of youth and the marketplace - provides 
an important stimulus for change in the JTPA 
system. Increasingly, practitioners and policy 
makers on the local level are going to have to 
begin to reexamine their mission and to begin 
reworking the tools they have available. This 
will not be an easy process. Little of what has 
been presented here can be bought "off the 
shelf or designed and put into place in a few 
weeks or months time Improving and 
expanding services to youth is going to take 
time and energy, and it is gc.ig to require 
making an investment now with an eye on the 
longer term. 

As the section that follows suggests, it is 
important that that investment take place not 
only at the local, but also at the state level. In 
order to create and direct an effective "high 
performance" program for at risk youth, it is 
imperative that SDA, PIC and program 
representatives participate in policy decisions and 
debates at the state level as well as design 
decisions in their own back yard. Through the 
development of a participatory policy 
development process, forward thinking local 
practitioners can act as effective change agents 
As the first to connect policy with practice - 
to test a "model" with "real people", local 
practitioners need to move state level policy 
makers towards adopting a top-down-bottom-up 
strategy for policy making and performance 
management so that state level actions support 
rather than impede effective programming on the 
local level. By working together on both 
program design needs and performance 
management goal*, the state and local leaders 
from employment and training, education, and 
social services can establish a coherent and 
consistent approach to increasing services to at- 
risk youth. 
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State Strategies: 
Policy and 
Performance 
Management 

Though the basic structure of JTPA's 
performance management system is established at 
the federal level, and program design and oper- 
ations take place locally, state polic> and 
program decisions play a pivotal role in shaping 
and influencing the services provided to youth. 
Through the definition of statewide goals and 
objectives. Governor's can articulate a vision for 
the state's youth serving system and establish 
the importance ot a comprehensive strategy for 
serving those most at risk. Through performance 
standards and incentive grant policies, v target- 
ing of discretionary funds, the use of technical 
assistance and monitoring strategies, and other 
state-level actions, states can support that vision, 
creating new opportunties for ana reducing 
barriers to longer-term, more intensive pro- 
gramming. States can provide concrete incentives 
to directly encourage specific types of services, 
such as basic skills education, or service to 
individuals who are particularly at risk. And 
through coordination among youth serving 
systems, they can allocate youth resources more 
effectively and increase the array of services 
available to support employability development. 

This section reviews some of the specific- 
ways in which states can use a variety of 
performance management tools to support 
increased investments in the long-term 
employability of young people In reading 
through the section, there are several general 
points that policy makers and practictioners 
should keep in mind: 

A Multi-Faceted Strategy Works Best. While 
each set of policy tools and options is discussed 
separately (and some under several headings), 
none of these policy tools can truiy stand alone 
The most effective state performance manage- 
ment strategies are those that use a combination 
of tools - performance standards plus incentives 
plus discretionary grants plus technical assistance, 
for example - to achieve one or more clearly 
defined ends. 



Policies Must Be Consistent Policy makers 
need to make sure that their performance 
management decisions point in a consistent 
direction and are not internally contradictory. At 
the state level, policy makers need to be sure, 
for example, that performance standards policies 
aimed at encouraging comprehensive pro- 
gramming (such as selection of the employability 
enhancement standard) are not offset by 
incentive policies that reward short-term, low 
cost programs. Similarly, the way in which 
states define at-risk youth should be consistent 
across policies, so that at-risk youth are not 
defined in terms of demographic characteristics 
for one set of programs and in terms of skill 
levels for another. At the local level, the need 
for consistency is equally strong: SDAs need to 
make sure that the performance standards they 
apply to each service provider are consistent 
with the services they want delivered. In this 
case, consistency means recognizing differences 
in program strategies and not simply applying 
the same performance standards across the board. 

Performance Management is a Process that 
Depends on Collaboration. State policy 
actions will have the greatest impact when there 
is "buy in" at all levels of the employment and 
training system and when there is consensus on 
goals among key players. To achieve that con- 
sensus, states need to make an honest commit- 
ment to ongoing collaboration and discussion on 
several levels: between systems, to define 
common goals and strategies among agencies 
before decisions are made; and among the levels 
of the JTPA system to insure that providers. 
SDAs and states are moving in the same 
direction. 

Performance Management is an Ongoing 
Process. To be effective, performance 
management also has to be understood as an 
ongoing and flexible process Like any 
management tool, state policies need to be 
regularly evaluated to see it they are 
accomplishing their goals, and they need to be 
revised if they are not. 

The final point is that performance 
management extends to almost every policy and 
planning decision that states can make. While 
this paper focuses on a number of specific 
performance management strategies (using 
performance standards and incentive policies, 
increasing coordination, etc.). states also need to 
look at other, less structured means of 
encouraging localities to serve at-risk youth. 
Tools such as the Governor's goals and 



objectives statement or the annual Title IIA and 
IIB planning guidelines offer states valuable 
opportunities to affirm the importance of serving 
at-risk youth and to remind SDAs of he need 
to consider the appropriateness of their program 
designs. Though a goals statement on increased 
service to youth, or a planning question about 
what basic skills services are available may have 
only a marginal impact, when combined with Jie 
policies discussed here, they can help to move 
the employment and training system forward. 

Using Performance Standards 
and Incentive Policies to Support 
Longer, More Intensive Services for 
Those Most in Need 

To serve at-risk youth effectively, states need to 
find new ways of encouraging local JTPA 
programs to target services to those most in 
need and to invest JTPA funds in longer, more 
intensive services - those incorporating basic 
skills instruction, competency-based training, and 
substantive pre -employment/work maturity skills. 
JTPA's performance standards system represents 
one of the most powerful tools available to 
states for achieving these goals. In a 
performance-driven system, these standards 
determine the ' bottom linc^" of performance at 
the local level. Because they apply to the 
mainstream of JTPA funds (Title IIA) and 
provide the basis for substantial incentives and 
sanctions, performance standards policies can 
significantly influence who is served and the 
kinds of services that are offered. 

Within JTPA's performance standards system. 
Governors are responsible for making a number 
of critical decisions in determining state 
performance standards policy. They determine 
which of the federal performance measures to 
adopt, whether and how to make adjustments for 
local circumstances, how to define when 
standards have been mei or exceeded, whether to 
create additional state standards, how to apply 
sanctions and how to reward performance with 
incentives. Individually, each of these decisions 
has the potential to encourage or discourage 
services to youth and to raise or lower barriers 
to comprehensive programming. Taken together, 
they offer an opportunity to move a state's 
JTPA system towards, or away from, a policy 
goal ot serving at-risk youth. 

Selecting Standards: 

The Combination is Important 

One of the most critical you f h performance 
management decisions a Governor can make is 
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the selection of performance measures. Under ttv 
March 1988, revisions to the JTPA performance 
standards system, Governors can now select 
which 8 of the 12 federal perfoimance standards 
they want to use to measure performance in 
their states. Included among those standards is 
a new youth performance measure - 
employability enhancement - which is defined 
as competency attainment or a non-placement 
outcome such as return to full-time school, 
completion of a major level of education, etc. 
As a result of those changes. Governors can 
now establish employability development as a 
JTPA performance standards priority and directly 
encourage program outcomes other than job 
placement. 

The creation of the employability enhancement 
standard marks a significant change for the 
JTPA system. Until this year, JTPA performance 
standards have placed little pressure on SDAs to 
provide intensive, employability development 
programming. Both of the original JTPA youth 
outcome measures, entered employment and 
positive terminations, allow SDAs to deliver 
programs that may be large'y focused on 
placements and that may not emphasize building 
the basic and work skills needed for long-term 
success in the labor market, even for those 
youth most at risk. While such "enhancement" 
outcomes as return to school or achieved major 
level of education are included in the positive 
termination rate, that standard itself does not 
provide a strong incentive to serve more at-risk 
youth or provide longer-term skill development. 
SDAs can still meet their goals through short- 
term job placements alone. 

Adopting Enhancement. By adopting the new 
employability enhancement measure, however, 
states can legitimize outcomes other than high 
volume placement and directly encourage more 
intensive, competency-based programming for 
higher risk youth. States that select the 
employability enhancement measure can now 
send an unambiguous message to SDAs and 
PICs that they need to develop effective youth 
competency systems, that they need to design 
programs that provide basic educational, 
occupational and substantive pre-employment/ 
work maturity skills, and that they need to begin 
providing those services to larger numbers of 
youth with substantial skill deficits. 

The adoption of the employability 
enhancement standard is one of the most 
effective ways states can encourage employability 
development for at-risk youth. Without it, states 
have little leverage by which to move local 
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programs toward more intensive services or 
Coward services to less job ready young people. 
!n considering the enhancement standard, 
however, states also need to recognize that 
employability enhancement, in most cases, is an 
inteim outcome in the employability 
de\elopment process. Employment in a quality 
job is still the ultimate goal of the youth 
employment system. In many states, then, the 
selection of the employability enhancement 
standard has been combined with .selection of 
the youth entered employment rate, thereby 
underscoring the importance of employment as 
the linal outcome for job ready youth and the 
necessity for more intensive employability 
development efforts for those youth not ready to 
enter the labor market. 

A Phased-In Approach. While acknowledging 
the value of the employability enhancement, a 
number of states around the country have 
decided not to select the employability standard 
out of concern that local competency systems 
ani programs may not be ready and that few 
SDAs would be able to meet their performance 
goals in the first year. One approach those states 
may want to consider is to phase-in the new 
standard over time. In Illinois, for example, the 
employability enhancement standard has been 
^elected for use in making incentive awards in 
PY '88, but will not be considered for 
sanctions. In 1989, the new standard will go 
into effect for both sanctions and awards. By 
us:ng a phased-in approach, states can establish 
the;'' commitment to enhancement and make 
SDAs aware of the need to change without 
pepa'izing those who are not immediately ready 
to romply with the new requirements. 

Eropkt; ',?ent and Enhancement: The Issue is 
Quality. The selection of performance standards 
sends a clear message to SDAs about the kinds 
of outcomes that are expected for the young 
people being served. However, states also need 
to recogni/e that the standards alone cannot 
guarantee program quality While adoption of the 
enhancement standard, for example, can 
encourage increased and more intensive services 
to at-risk youth, the standard cannot by itself 
ensure that employability enhancement outcomes 
reflect meaningful skill gains, or that 
enhancements are being provided to appropriate 
youth, any more than the entered employment 
standard ensures placement in a quality job. As 
one Task Force member commented, the 
question remains, "how do we make sure that 
there are no second rate outcomes for high risk 
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youth?" To accomplish that goal, state and 
local policy ma^rs together need to look 
beyond the standards to the question of what 
kinds of outcomes are appropriate for which 
youth and how terms like "positive termination" 
or "job placement" are best defined. There are 
no easy answers to these issues - what is an 
effective entry work experience for one youth 
may be a dead end job for another. But as the 
Task Force members reminded us. the issue of 
insuring that each youth is receiving quality 
services that are appropriate to his or her needs 
is at the heart of the employability deve'opment 
challenge. 

Costs and Incentives 

The other key standard for youth is the cost per 
positive termination measure. There is 
considerable debate over the value of the cost 
standard nd its impact. Proponents suggest that 
the cost standard provides an important measure 
of efficiency and is a key element in 
maintaining business support of JTPA. Opponents 
of the cost standard argue that its use 
encourages SDAs to focus on low-cost, 
placement-oriented programming that is unlikely 
to provide long-term benefits for at-risk youth. 
Many practitioners have also pointed out that, 
since the reported cost figures do not include 
program investments made by partner agencies, 
they cannot provide an accurate or consistent 
measure of program efficiency. Low costs in one 
SDA may be the result of extensive interagency 
collaboration while in another it may reflect an 
emphasis on "quick-fix" programs. 

At least one recent study indicates that the 
cost standard does have the significant 
"unintended" impact of discouraging intensive, 
higher cost programming for both youth and 
adults. Much of that impact comes from the 
way that the standard is used in conjunction 
with incentive policies. The greatest negative 
irrpact is in those states where the incentive 
grant structure heavily rewards those SDAs with 
the lowest costs; that is. where incentive grant 
awards are weighted toward the cost standard or 
where the size of incentive awards for costs is 
directly related to degree to which the standard 
is exceeded. 

Cost Standard Options. As a result, states 
need to look at the selection of performance 
measures and incentive policies together to 
insure that they are consistent in encouraging 
programs aimed at employability. In terms of the 
CCS' standard a number of strategies should be 
considered: 



• States may decide to not include the youth 
cost standard in their performance standards 
system. By doing so, states will open the door 
for SDAs to conduct more intensive, higher cost 
programming. However, they will also be giving 
up their means of measuring program efficiency. 
In that instance, states may want to consider 
developing a state standard that more effectively 
measures real costs. 

• States that want to encourage employability 
development and still maintain some cost control 
can select both the enhancement standard and 
the youth cost standard, but not apply incentive 
dollars toward achievement of the cost standard. 
Both Illinois and Ohio selected this option. In 
Ohio, SDAs are required to meet the cost 
standard to be eligible for incentive awards, 
though the standard was "0 weighted" in 
calculating the actual awards. In Illinois, the cost 
standard continues to be considered in 
determining sanctions, thereby providing an 
upper limit on average costs. In both states, 
however, the decision to not award incentive 
dollars on the basis of the youth cost standard 
effectively eliminates the incentive for SDAs to 
try to push costs down in order to increase their 
incentive grants. 

• States that want to maintain incentives for 
costs can limit their negative impact by 
awarding a smaller proportion of incentive 
dollars for exceeding the cost standards than for 
other standards, and by placing a "cap" on the 
incentive awards that limits the degree to which 
SDAs are rewarded for exceeding the standard. 

• Lastly, states may also consider adjusting the 
cost standard upward through a Governor's 
adjustment, thereby reducing the incentive for 
SDAs to fuither reduce costs and giving SDAs 
freedom to provide more intensive training. 

Adjustments to Standards: 
Leveling the Playing Field 

Another strategy that Governors can use to 
encourage more intensive programming and 
services to higher risk populations is to make 
adjustments to the federal performance standards 
to take into account the provision of special 
types of services or services to particularly hard- 
to-serve populations. The rationale for making 
adjustments is that the national performance 
standards adjustment model developed by DOL 
does not adequately reflect the impact on local 
performance of serving youth with limited basic 
skills or other barriers to employment, or of 
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providing higher cost, more intensive services. 
Unadjusted standards, as a result, may act as a 
disincentive for SDAs to serve large numbers of 
at-risk youth or provide comprehensive services 
because those SDAs would have to meet the 
same performance levels as SDAs serving a less 
hard-to-serve population. Through the adjustment 
process, states can "level the playing field" again 
by taking into account the higher costs or 
reduced outcomes that may accompany 
employabihty development programs. 

Adjustments within Tolerance Levels. There 
are several types of adjustments that Governor's 
can make to the national performance standards. 
The first is to adjust the results of the national 
performance standards model upwards or down- 
wards within that model's "tolerance levels" - 
a measure of the model's statistical imprecision. 
The use of these adjustments, which range from 
plus or minus 3.4% to 5.6% for the youth 
placement, termination, and enhancement 
standards, and plus or minus $310 for the youth 
cost standard, requires no additional justification 
to DOL. Consequently, they have the advantage 
of providing an easy method of lowering or 
raising performance expectations statewide. As 
noted above, for example. Governor's may 
consider using this adjustment to raise the youth 
cost standard as a means of encouraging greater 
investments in youth programs. A number of 
states build these adjustments directly into their 
performance standards system by defining 
performance results anywhde within the 
tolerance levels as "meeting" the standards, thus 
allowing some flexibility in performance 
expectations. In making these adjustments, 
however, two points should be kept in mind 
The first is that the impact of these adjustments 
will vary according to how the state's incentive 
policies reward SDAs that meet or exceed their 
standards. States also need to recogni/e that the 
performance management impact of this type ot 
adjustment will be limited since it cannot be 
linked to the specific SDA performance; 
everyone benefits whether or not th«- are 
making an effort to ser\c at-risk j.uuh. 

Adjustments Beyond the Model. A second 
type of adjustment is adjustments to the national 
model itself, by adding factors not in the DOL. 
model in calculating local standards or by 
negotiating specific adjustments based on clearly 
identified criteria. States should be willing to 
work with SDAs requesting adjustments i*nd 
consider making adjustments for such factors* as 
provision of basic skills education or service to 
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at-risk youth not already included in the DOL 
model (such as youth with limited basic skills). 
The Department of Labor's technical assistance 
guide on performance standards offers some 
information on how these kinds of factors may 
be incorporated into the model. 

The development J adjustment strategies is 
one of the areas in which states and localities 
may want to coordinate with education and other 
youth serving institutions. SDAs may find, for 
example, that iocal schools or youth agencies 
can provide the data and program experience 
with remediation programs or with specific at- 
risk populations that is needed to make a case 
for a performance standards adjustment. 
Similarly, state JTPA agency staff may want to 
draw on other state agencies, including 
education, for assistance in evaluating SDA 
adjustment proposals. 

A recent study of the performance standards 
system found that state adjustments, particularly 
to account for basic skills instruction, have 
resulted in increased services for hard-to-serve 
individuals. However, the study also notes that 
many of the state and SDA staff surveyed were 
not comfortable with current adjustment 
procedures "State staff felt unsure about how to 
establish equitable criteria for adjustments 
beyond the model and about how to determine 
the appropriate si/e of adjustments. SDA staff 
often felt that they did not understand the 
statistical basis of the models well enough to 
justify adjustments." Task Force members echoed 
these findings, noting that, since these 
adjustments are subject to DOL review, many 
states see further federal guidance and improved 
adjustment modeling as essential to the more 
active use of performance standards adjustments 
Where states do feel comfortable with the 
adjustments process and want to encourage more 
intensive services through these adjustments, thev 
may want to provide additional technical 
assistance to their SDAs on the adjustment 
process and its impact. 

State-Based Models The third approach to 
performance standards adjustments is the 
development of state-based statistical adjustment 
models to replace that developed by the 
Department of Labor. In Region V, all of the 
states participated in a project to develop state 
performance standards models, and one of the 
states, Illinois, implemented its model in I98X. 
For states interested in using performance 
standards to encourage increased services to 
youth, state-based models have several 
advantages: 
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• Since the models are based on participant-level 
data and not limited to data available on the 
JTPA Annual Status Report, the state is in a 
position to include adjustment factors (e.g. math 
and reading ability or multiple barriers) that 
reduce performance expectations to the extent 
that an SDA serves hard-to-serve or "at-risk" 
populations. 

• The state is also able to include adjustment 
factors that reduce performance expectations in 
selected performance areas if an SDA increases 
its emphasis on the provision of long term 
occupational classroom training and academic 
training. 

• State and regional models are also technically 
superior to the alternative federal models in 
terms of stability from one year to the next and 
the ability to predict performance (i.e. fewer 
sign reversals, same factors and similar factor 
weights). Therefore, state models provide a more 
stable policy environment and do a better job of 
adjusting performance expectations based on the 
populations served, local economic conditions 
and the local mix of services. 

Advantages and Disadvantages of State-Based 
Models. The advantages of state-based models 
are evident in the capacity to develop a 
performance standards system that is tuned to 
the state's definition of at-risk youth and that 
can take into account such program factors as 
type of training or participation in basic skills 
programs. In Illinois, for example, factors not in 
the DOL model, such as as rural residence and 
teen parent, are incorporated into the state 
adjustment model for youth entered employment: 
the positive termination rate mode! includes 
factors for participation in occupational 
classroom training or an exemplary youth 
program Equally important, the development of 
an effective state-model (or a good state 
adjustment process generally) requires states, 
SDAs, and services providers to reach up-front 
agreement on the goals of the system, definitions 
of youth, and specific measures of program 
activity and quality. Ideally, such a process will 
lead states and SDAs toward a more consistent 
approach to youth employability development 
and employment. 

However, the state adjustment process is not 
cost free. Whether pursuing state-based models 
or making more limited adjustments, states are 
largely limited by the inf rmation collected 
through their management information systems If 
those systems can only collect standard DOL 



reporting data, state modeling will offer few 
advantages. In considering state-based models, 
states also need to examine the time and costs 
involved States should not undertake the state 
modeling process without staff that have a high 
level of technical sophistication and an MIS 
system that is able to incorporate new data 
elements. States and SDAs must also be willing 
to invest the time necessary in analyzing and 
negotiating system options and the funds 
necessary for data collection and analysis. Those 
states that are best positioned to develop state 
models, therefore, are those with a well- 
developed MIS that can access SDA level data, 
with an MIS staff willing to devote time to 
developing a system, and with a nearby 
university with the appropriate knowledge and 
capacity. 

State Standards As A 
Supplement to Federal Measures 

The creation of state performance standards to 
supplement the federal measures is, along with 
selection of the employability enhancement 
standard, one of most direct methods available 
to states for encouraging services to at-risk 
youth. State standards provide an opportunity for 
states to build their youth priorities into the 
performance standards system by targeting 
incentives to more specific performance criteria 
than are allowed by the national measures. The 
range of options is almost infinite: 

• States may want to use state standards to 
directly encourage services to youth who are 
considered most in need or hard-to-serve. In 
Ohio, for example, the state has established a 
standard for service to welfare recipients in 
which additional incentive funds are awarded for 
higher levels of services to hard-to-serve 
participants (long-term welfare recipients, 
offenders, etc.). Similarly, a state also could 
establish a standard requiring that a certain 
percentage of youth gaining employability 
enhancements face one or more clearly defined 
skill deficits or employment barriers 

• State standards also can be used to encourage 
specfic types of service strategies or to 
differentiate service strategies for different 
groups. States may, for example, want to 
establish a standard aimed at encouraging 
dropout prevention programs by rewarding 
service to m-school youth or by defining 
separate enhancement standards for in-school and 
out-of-school youth. 
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• States may also encourage longer term 
programs by creating standards that identify 
interim outcomes for youth remaining in 
programs over a period of years. By defining 
standards that reward incremental basic skills 
gains, for example, states can encourage SDAs 
to enroll higher risk youth who might require 
several years of assistance before terminating 
from JTPA. 

• State standards can also be used to increase 
the overall resources focused on youth. States 
could establish a standard for meeting or 
exceeding the 40% youth expenditure level. 
Similarly, at least one state (Ohio) has 
established a standard that rewards interagency 
linkages. In that state, incentive funds are 
awarded to SDAs that can demonstrate 
excellence in developing "system building" 
collaboration with the Employment Service, 
human services agencies, economic development 
and/or education. SDAs are evaluated through a 
two-part process (including a site visit) that 
considers such factors as coordination in 
planning, service delivery, use of resources, and 
monitoring; PIC role; benefits to participants and 
employers; and future plans. 

Connecting, Not Competing, Priorities 

Whatever particular goals are chosen, the 
standards need to measurable and clearly 
defined. They also need to reflect a consistent 
approach to defining at-risk youth and 
employability. In states that define the at-risk 
population in terms of demographic charac- 
teristics, the standards should reinforce that 
approach, e.g. reward services to dropouts, 
teenage parents, welfare recipients, etc. In a state 
that supports a definition of at-risk that focuses 
on skill deficiencies, the standards should be 
designed to reward services, for example, to 
participants reading below the 7th grade level or 
to youngsters two or more grade levels behind 
in school or to those lacking prior work 
experience. Similarly, in states that have adopted 
a more "hybrid" definition, using a combination 
of socioeconomic and skill-based characteristics 
to define those targeted for priority services, 
standards should reflect and reinforce that 
definition. What states need to avoid are the 
mixed messages that result from using different 
definitions for different policies - one definition 
for at-risk youth in a state performance standard, 
and a different definition in policies for 6% 
hard-to-serve funds or its 8% grants. 

While every state will differ in its approach, 
the state standards do provide an important 
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opportunity to go beyond general JTPA goals 
and to promote specific types of activities and/or 
levels of performance from SDAs. In areas 
ranging from the direct encouragement of inter- 
agency coordination to the expansion of services 
to particular at-risk populations and the provision 
of longer term, competency-based training, state 
standards provide states with an valuable tool 
for furthering their youth policy priorities. 

Incentive Policies: Leveraging 
Program Quality for High Risk Youth 

The effectiveness of the performance standards 
>ystem depends in large part on the way in 
which JTPA's 69c incentive funds are used to 
reward performance. While the the JTPA 
legislation emphasizes equity in the distribution 
of incentive awards, states need to ensure that 
their incentive policies are consistent w,th their 
performance goals and are designed to leverage 
maximum program quality. States also need to 
be sure that their incentive policies are not so 
complex and technical as to confuse local 
administrators. As a recent paper by the National 
Governor's Association notes, "incentive policies 
are especially influential when the policy is 
simple and clearly linked to stated policy 
objectives." 

In developing incentive policies, states have a 
number of choices to make, including which 
standards to reward and by how much, what 
thresholds to set for awards, how and if to 
award SDAs for "exceeding" standards, how 
much of the 6 C A grant to apply to incentive 
awards, and how SDAs can use that money. 
Each of these decisions offers opportunities to 
encourage increased and improved services for 
youth: 

Rewarding Enhancement Not Costs. One of 
the ways states can encourage more intensive, 
longer-term services is by reducing the 
incentives for low cost programs and increasing 
those for employability enhancement. As noted 
above, several states have stopped awarding 
incentive funds for the youth cost standard by 
"0 weighting" that standard in calculating 
incentive grants. Equally important, however, 
states can provide positive incentives for the 
development of competency systems and 
programs for at-risk youth by apportioning larger 
shares of their performance award dollars to the 
employability enhancement standard. Taken 
together, those two options provide a clear 
message about the relative importance ,tates 
place on cost versus the development of long- 
term employability. 
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Supporting Programs for the Hard-lo-Serve . 

States can also reinfoice their commitment to 
serving at-risk youth by setting aside a 
signficant share of their 6% funds to fund or 
reward services to hard-to-serve populations. 
States can use 6% funds to provide incentive 
awards to SDAs that serve one or more target 
groups above « specified level or in proportion 
to or above their incidence in the population. As 
with state standards, these hard-to-serve awards 
can provide an added incentive for SDAs to 
focus more of their services on those youth who 
need the most assistance. Using 6% funds in 
this way also provides states who are unwilling 
to select the enhancement standard with a way 
of phasing in incentives for serving high risk 
youth. 

States can also require SDAs to use a portion 
of their 6% incentive awards for services to 
hard-to-serve populations. In Ohio, SDAs must 
use at least 25% of any performance awards 
they receive to serve hard-to-serve participants. 

States can also use 6% funds to directly 
support services for hard-to-serve populations 
through grants for special programs. In 
Michigan, for example, the state's "Hard-to- 
Serve Initiative" uses 6% monies to fund multi- 
agency programs serving hard-to-serve individuals 
(including at-risk in-school youth and dropout 
youth) through interagency planning and 
integrated service delivery. Innovative, high risk 
projects often emerge fiom this kind of use of 
6 c /( incentive monies. These piiot "set aside" 
initiatives may later be mainstreamed into II A 
and thereby provide the basis for significant 
institutional change within the JTPA framework 
and among partner agencies. In using 6% funds 
to support innovative projects, states need to 
include provisions to ensure that this main- 
streaming takes place and that 6% projects are 
not continued indefinitely outside of the 
performance standards system where their long- 
term impact on the employment and training 
system may be limited. 

Minimum Requirements for Awards. States 
can also influence services to youth through the 
minimum requirements they set for SDAs to 
qualify for incentive funds. Currently, there is a 
wide variation among states in how many 
performance standards SDAs mus* meet to 
qualify for incentives. Some require SDAs to 
meet all eight standards to qualify for any 
awards. Others have established primary and 
secondary standards, designating several required 
standards, such as employability enhancement, 
while leaving SDAs a degree of choice. Others 



require SDAs to meet five of eight standards to 
qualify, or to only meet one. In most cases, the 
issue in establishing a threshold is the degree of 
flexibility states want to allow SDAs in setting 
their program priorities versus using the 
threshold requirements as a means of enforcing 
a general level of program quality. Some states 
may, for example, want to consider requiring 
SDAs to meet the employability enhancement 
standard as a minimum requirement for any 
incentive awards as one means of ensuring that 
SDAs are providing programs for at-risk youth. 
Others, however, may prefer not to place extra 
emphasis on any one particular standard. 

In addition to identifying which performance 
standards must be met to qualify for incentives, 
states can also tie incentive awards to levels of 
service. Several states have built into their 
incentive system policies that reduce the amount 
of incentive funds if minimum service levels foi 
at-risk youth are not achieved. In an effort to 
ensure services to youth, others tie the size of 
the incentive award to the level of SDA youth 
expenditures. 

Capping Awards As discussed earlier, the 
way in which c tates award funds for meeting 
and exceeding standards can also have a 
significant impact on youth services. Where 
grant awards rise with the degree to which each 
standard is exceeded, incentive policies tend to 
create pressure for low cost, quick placement 
programs. States can limit this competitive 
pressure by creating distinct pools of funds for 
each standard an^ by putting a "cap" on the 
awards an SDA can earn. In Illinois, for 
example, an SDA ean's the bulk of its incentwe 
awards if it meets or exceeds its standards by 
up to 10%. However, the incremental awards for 
higher performance levels ^re mur** smaller, and 
no additional funds are awarded for performance 
that exceeds the standards by more than 20%. 
Similarly, m Minnesota, SDAs can earn 60% of 
their incentive awards for each standard by 
meeting it or exceeding it by one tolerance 
factor, 30% for exceeding a standard by 1-2 
tolerance factors, and 10% for exceeding by 
three or more. In both cases, the states have 
reduced the incentive for low cost, quick-fix 
programs by eliminating grants for unusually 
high performance results. 

Incentives and Performance Standards. As a 

result of the recent JTPA revisions, Governor's 
now have the option of deciding whether or not 
to apply performance standards to the use of 
incentive awards. A number of states have used 
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this new authority as one final means of 
encouraging services to at-nsk youth. In 
Michigan, for example, the Governor has 
prescribed a variation to the standards to reflect 
services to hard-to-serve participants. Performance 
standards reflect the exclusion of hard-to-serve 
participants and associated costs for the purpose 
of awarding incentive grants. In Indiana, the 
state will also exempt 6%-funded programs from 
performance standards calculations, but requires 
SDAs to apply for and justify the exemption. 

States should recognize that, as with other 
options, this approach involves some trade offs. 
On the one hand, for many SDAs, the impact 
of excluding hard-to-serve participants from 
performance standards calculations may be 
limited, and their inclusion in the calculations 
may even result in a more favorable 
performance standard. At the same time, states 
need to recognize that by excluding 6% funded 
services from performance standards calculations, 
they are giving up an element of quality control. 
T!ius, while freeing SDAs to develop more 
innovative or experimental approaches for hard-to- 
serve youth, the benefits of exempting 67r funds 
from performance standards may be limited and 
states may want to closely monitor its use. 

Investing in Technical Assistance . Finally, 
states may decide to invest a signficant 
proportion of their 6% funds in technical 
assistance. As discussed later in this guide, 
technical assistance programs can be used to 
orient local staffs to the needs of at-risk youth, 
to help develop improved programs and systems 
(such as competency systems), or to pilot 
program tools such as curriculum. When used in 
conjunction with performance standards and 
incentive policies aimed at moving SDAs 
towards increased and improved services for 
youth, that technical assistance can be a critical 
step in translating policy into operating 
programs. 



Increasing Coordination: Towards 
a Comprehensive System for Youth 

JTPA's performance standards and incentive 
policies provide critical tools for moving JTPA 
programs toward longer, more intensive services. 
But one of the clearest messages to emerge 
from the Region V Task Force was the equally 
important need to build a more coordinated 
approach to serving at-risk youth. Youth who 
are at-risk of failure in school or of chronic 
unemployment today bring with them a 



constellation of needs: for basic skills education 
and work skills, but also for counseling on 
family issues, treatment for drug or alcohol 
abuse, housing assistance, day care and the like. 
At the same lime, as the funds for social 
services decline, it is clear that states and 
localities can no longer afford the fragmented 
and duplicative approach to services that has 
been common in the past. Neither JTPA nor any 
other youth system on its own can provide the 
comprehensive services that meet the range of 
youth needs. The coordination challenge facing 
states, then, is to develop a coordination strategy 
that brings together the resources available for 
serving youth, that broadens the range of 
services available to each at-risk young person, 
and that does so in a way that minimizes 
administrative barriers for administrators and for 
participants. The more difficult coordination is 
for planners and service providers, or the more 
compl.cated the service delivery process appears 
to youth, the less likely effective coordination 
will take place. 

Coordination Lessons 

Among the Region V states, the development of 
coordinated strategies for youth was a high 
priority. Who was involved in coordination 
activities varied substantially, in part according 
to how states defined their approach to at-risk 
youth. Generally, education was seen as the 
most critical partner. But where states took a 
comprehensive approach to at-risk youth, looking 
beyond employability skills to additional barriers 
to independence, they also made an effort to 
bring in other agencies, such as youth services, 
welfare, or public health systems. 

However broad 01 narrow the coordination 
effort, successful collaooration meant changing 
the ways in which institutions related to one 
another. While there arc no simple formulas for 
bringing about that change, the coordination 
experiences of the Region V states do suggest a 
number of basic lessons: 

Begin with the Issues, not the Act. While 
JTPA offers a number of tools to support and 
encourage coordination (such as Coordination 
Criteria and the 87r Education Grants) the key 
to many of the Region V initiatives has been 
the development of an interagency collaborative 
process prior to making JTPA-specific policy 
decisions. Effective coordination begins by 
defining common interests, by organizing 
agencies around a set of issues, and by 
developing a broader state strategy for serving at- 
risk youth of which ITPA is one part. JTPA 



Winter/Spring 1989 



policies are then used to ratify, reinforce, and 
carry into effect an agreed upon collaboration 
policy rather than to try to establish it from 
scratch. 

State-Level Coordination is Key. The Region 
V states al:o recognized that coordination has to 
begin with agreements among state-level 
agencies. While the coordination that takes place 
on the local level has the most immediate 
impact on service delivery, the lack of 
agreements among state agencies is one of the 
most critical barriers to the successful creation 
of those local ties. (Task Force members also 
noted that the lack of agreements at the Inderal 
level is viewed as a primary barrier to state- 
level coordination.) Many of the administrative 
barriers to coordination, in term of program 
priorities, eligibility rules, funding cycles and the 
like need to be dealt with at the state level, and 
it is at the state level that the leadership needed 
to overcome longstanding turf issues must be 
exercised. To the extent that states want to 
encourage the development of integrated local 
delivcy systems, they need to set the context at 
the top. 

Coordination Is Based on Collaboration . As 

one of the Task Force options papers notes, 
"coordination is an unnatural act between non- 
consenting adults." It does not take place easily 
or quickly, and it rarely takes place solely as 
the result a written policy. The development of 
a coordinated strategy for youth at the state or 
the local level, then, has to reflect a broader 
commitment to collaboration and an awareness 
of the need to address a variety of often 
substantial barriers. Policy makers and 
administrators need to demonstrate leadership by 
being willing to take risks and by sharing their 
decision making povvei and their policy 
development process. They also need to be 
willing to invest time and energy in negotiating 
common goals, building trust, and working out 
problems. More than in any other area of 
performance management, coordination requires 
the "buy in" of all the key players. Because of 
that, the process is essential to tne product. 

Change Must Be Supported on Several 
Levels . As with every aspect of performance 
management, the most effective strategies for 
increasing coordination are those that make use 
of the full range of ava'labie tools and are 
implemented on several levels. Among the 
Region V states, there were coordination 
initiatives that involved developing a unified 



youth policy, that supported coordinated planning 
at the state and local levels, and efforts that 
created a framework for collaborative 
programming. However, the greatest potential for 
institutional change was evident where 
coordination was supported on all three leve ! s at 
the same time. Institutional change - in terms 
of redefined policy goals, shared resources, new 
service and new delivery structures - is most 
likely to take place where policy, planning 
strategies, and operating systems are all moving 
in the same direction. 

Coordination Must Have a Goal Implicit in 
all of the lessons listed above is the most 
important: coordination must have a clear focus 
and a goal. For practitioners and policy makers 
to invest their time and energy in coordination, 
there must be a clear rationale and readily 
identifiable, mutual benefits. As the options 
paper from Wisconsin notes, "A coordination 
effort which is not focused and relevant to 
everyone's needs [coordination for coordination's 
sake!] will quickly lose the interest of busy 
people." 

The Coordination Goal: A 
Comprehensive Approach to Youth 

For states that want to expand and improve 
services for at-risk youth, the goal of 
coordination is the development of an effective, 
comprehensive service delivery system. As 
outlined earlier in this guide, that means a 
system that can provide a flexible and varied 
program mix, intensive and long-term 
programming, and an integrated and collaborative 
approach that offers an array of services that 
can be accessed in a graduated sequence. To 
achieve that goal, states and localities need to 
find ways of establishing shared goals and 
objectives for diverse youth serving agencies so 
that programs aim at a common outcome. 
Planning and resource allocation needs to take 
place in a way that eliminates unnessary 
duplication of services while fostering 
development of programs that fill existing 
service gaps. Program staff need to be aware of 
existing services and have the tools needed to 
move participants from service to service across 
agency ' Finally, participants need to be 
able to access those services with a minimum of 
administrative barriers. 

Coordination, in this context, is a means to an 
end. In this case, the desired end is support for 
a comprehensive youth system. The strategies 
outlined here, which include the development of 
common goals and definitions, joint planning and 
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funding, and administrative initiatives, are all 
aimed at bringing together and organizing 
resources for at-risk youth and at reduce the 
barriers to a flexible, integrated youth service 
delivery system. 

Agreeing on the Definition 

One of the most significant banners to 
collaboration is the lack of a common language 
and definitions, goals, and eligibility guidelines 
among youth-serving systems. A the Federal 
level, for example, income guidelines differ 
among such programs as JTPA, school lunch 
programs, TJTC, welfare and food stamps. 
"Youth" are defined differently under JTPA, 
Wagner-Peyser, TJTC and welfare. Programs also 
differ substantially on such terms as 
"remediation," "competency-based," "placement," 
and "enrollmeni " In many states, these 
differences are repeated in state level legislation 
and policies. As a result, each system has its 
own goals, its own programs, and its own 
prionties, resulting in fragmentation, competition, 
and duplication of services. 

The most effective starting point for 
collaborative programming, then, is the 
development of a common approach to the 
issues of at-risk youth. The key step in that 
process is the negotiation of common goals and 
definitions among the various youth-serving 
agencies: identifying who is at risk, what 
outcomes are appropriate, what kinds of services 
are needed to achieve thnse results On one 
level, the process of developing shared goals and 
definitions of at-risk youth is a critical factor in 
getting agencies to focus on the needs of young 
people rather than on their institutional interests 
and to recognized their common commitment to 
helping youth. On another level, the development 
of common definitions should lead to the 
adoption of identical language and coordination 
goals in the policies of the various collaborating 
agencies. As the representatives of one state 
pointed out, the incorporation of the same or 
similar language in the policies and/or legislation 
of several systems is one of the most effective 
coordination strategies because it means that the 
field staff in all the programs are hearing the 
same tune. 

Several of the Region V states have moved 
toward a unified youth policy through legislation 
that defined a comprehensive approach to youth 
or a particular se; of youth issues. Through that 
legislation, priorities were set, common 
definitions were established, roles defined, and 
funds made available to help smooth the gaps 
between existing services. 
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• In Wisconsin, the state's Children At Risk 
Legislation (1 985) establishes a framework for 
collaboration on dropout prevention between 
schools, JTPA, and other community agencies. 
The legislation defines youth at-risk and requires 
school districts to develop dropout prevention 
programs in cooperation with other community 
agencies. As a result of that legislation, the 
state's JTPA and education agencies have 
developed common coordination criteria and 
program goals. The state's 8% coordination 
funds and Perkins Act funds are targeted to 
supporting those goals through the development 
of competency-based curriculum and by funding 
collaborative dropout prevention programs, and 
the state JTPA and education agencies have 
developed joint training initiatives for schools, 
SDAs and other youth agencies. 

• In Minnesota, the state's Departments of Jobs 
and Training, Education, Health and Human 
Services joined agreed to bring together their 
state budget proposals in a single, umbrella 
youth dropout prevention bill, now before the 
legislature. The legislation was developed in an 
effort to gain support for youth services 
generally and to eliminate the annual competition 
for funding among youth-serving agencies. 
Included in the legislation is funding to 
supplement JTPA Title IIB and to encourage the 
development of year-iound in-school 
programming, including remediation, basic skills 
instruction, case management, tutoring, mentoring 
and counseling services. 

Sharing Planning and Decision Making 

A second strategy for increasing coordination in 
serving youth is the development of a 
collaborative planning process at both the state 
and the local level that can develop joint 
programs, identity roles and responsibilities 
among agencies, and coordinate the allocation of 
resources - in short, a process that can 
translate broad policy goals into operational 
decisions. At the state level, one approach is to 
set up a special youth planning council 
involving all the state youth agencies to 
coordinate programs ?t the state level. In some 
states, these councils have been organized around 
the use of JTPA's 87r funds; in others they 
have grown out of state legislation or policy 
mandates or have been established to organize a 
specific project. 

States can also promote collaborative planning 
at the local level through the use of 
coordination criteria or the planning requirements 
for 8% grants and other special programs. As 




noted above, Wisconsin's Children At-Risk 
legislation encourages involvement of a broad 
group of local agencies in planning dropout 
prevention programs. Similarly, through the use 
of coordination criteria, Michigan's Governor is 
requiring a number of employment-related 
agencies to develop local plans for compre- 
hensive service delivery. 

While encouraging coordinated planning at 
both the state and the local level, states should 
make an effort to locate that planning in 
existing structures rather than create new, 
duplicative planning bodies. Where states 
agencies can reach agreement on the 
development of a joint planning process, they 
may want to identify an existing organization, 
such as the State Job Training Coordinating 
Council or local school boards or PICs, as the 
lead planning body for youth issues. 

States need to recognize, however, that the 
effectiveness of any coordinated planning effort 
depends on the willingness of the participants to 
take some risks and share decision-making. The 
designation of a state or local youth council is 
not in and of itself enough to increase 
coordination. Nor can states simply mandate trust 
or shared decision making. But the development 
of a collaborative planning process can create a 
context in which representatives of youth-serving 
agencies have to address common issues and 
identify their respective roles. And where it 
works, collaborative planning can have a major 
impact on program planning and operations by 
developing common procedures, program 
guidelines and funding schedules, issuing joint 
grants and RFPs, and planning complementary 
rather than duplicative programs. 

Lowering Administrative Barriers 

States can also significantly expand and ease 
access to a range of services on the program 
level by addressing the administrative barriers 
that block joint operations on a day-to-day basis 
These barriers can range from differences in 
agency planning cycles to location to intake 
forms. Together, these kinds of administrative 
issues can seriously hinder efforts to develop 
joint programs or to move young people across 
agency lines. States may want to consider some 
of the following strategies: 

• By establishing common planning and funding 
schedules and by developing and using joint 
RFPs, states can encourage local agencies to 
combine similarly targeted funds or discretionary 
grants and to develop collaborative programs. In 
one state, for example, the state JTPA and 



education agencies combined 8% and state 
dropout prevention funds in a single RFP for 
dropout prevention programs. By establishing a 
unified proposal format and reporting guidelines, 
and by coordinating th" funding, the agencies 
were able to require a single, comprehensive 
dropout p 1 ' i from the schools and SDAs. 

• States can also encourage collaborative 
planning by creating common boundaries for 
substate areas in JTPA, the Employment Service, 
education, and other youth serving systems. 

• States can support joint planning and improved 
access to services for participants by encouraging 
the co-location of employment and youth-related 
services. In Indiana, for example, JTPA and the 
Employment Service have merged at the state 
level and many local offices have co-located. 
States may also want to consider encouraging 
the location of JTPA offices in schools or co- 
locating intake services with welfare, health 
services, and other youth agencies. Similarly, 
joint staff training program:, can improve staff 
awareness of community resources and facilitate 
planning and referrals across agency lines. 

• States can also support comprehensive services 
and improved access by developing common 
intake, eligibility and assessment tools. In 
Michigan, as directed through the Governor's 
coordination criteria, core groups of local 
agencies have been formed to achieve joint 
planning and thereby improve access to job 
training and related services. These core groups 
are designing common intake, assessment and 
EDP planning tools for all job training related 
agencies. The state is also requiring local 
agencies to work together to de/elop criteria, 
methods, and plans to meet loca! needs, 
including the development of local, coumy-based 
resource directories. At the state level, agencies 
are identifying common information needs and 
formats. These common tools will make it easier 
for young people to move among systems and 
for institutions (such as schools and JTPA) to 
establish joint initiatives for a common 
population. 

Funding Coordinated Youth Services 

A final strategy for encouraging increased 
coordination at the local level is the funding of 
joint program operations Through the use of 8% 
funds, dropout prevention monies, and other 
resources, states can support the development of 
collaborative program models involving SDAs, 
schools, and otb^r youth-serving institutions. 



Youth Programs 



States can also develop new pools of funds 
designed to supnort comprehensive strategies for 
youth at-risk. As noted earlier, m Michigan, for 
example, a number of state agencies have pooled 
$1.2 million in funding in a joint "Hard to 
Serve" initiati . The funding is designed to 
support comprehensive services by filling the 
gaps between existing services. Similarly, states 
can move toward integrated services by 
channeling a variety of program funds through a 
single system, such as the PICs/SDAs or the 
schools. Indiana has taken this approach, using 
the JTPA system, in developing employment and 
training programs for food stamps recipients. By 
using a single delivery system for a variety of 
programs, states can reduce the duplication of 
services and support the more efficient allocation 
of youth-related resources. 

Reinforcing Coordination Through JTPA 

Where state agencies have reached agreement on 
the development of a coordinated approach to at- 
risk youth, several JTPA performance 
management tools can be used to reinforce those 
agreements and to help carry them into effect. 

L .king Work and Education: The 8% 
Grants. JTPA's 87< Discretionary Funds 
(Section 123) are explicitly designated as means 
of increasing coordination between JTPA and 
education. The funds can be used provide to 
services for eligible participants through 
cooperative agreements between education 
agencies and SDAs; to provide literacy training, 
dropout prevention services or school to work 
transition programs; or to facilitate state level 
coordination through cooperative agreements. 
HO c /c of the funds must be used to provide 
services to participants (e.g. a maximum of 20 f /r 
for state-level coordination), and the state must 
provide matching funds. 

Region V states have used their 8 r /r funds in 
a variety of ways: to jointly develop curriculum 
and materials, to fund demonstrations, and to 
leverage collaborative programs between JTPA 
and schools. Wisconsin uses its 8<7r funds to 
leverage the development of significant 
programmatic collaboration between schools and 
SDAs. Some of its 8% funds are used to 
support development of competency-based 
curriculum for use in schools and JTPA 
programs; however, the majority of funds are for 
programs for at-risk youth that are developed in 
accordance with strict guidelines and are 
designed to integrate the states JTPA, Children 
At Risk and Education for Employment 
initiatives. 



Other states are also using 8% funds to 
encourage coordinated and comprehensive 
services. Part of Michigan's 8% funds are being 
used to develop and pilot basic skills programs 
and competency systems for at-risk youth. In 
Ohio, 8'7< funds were used to develop a 
computer-ba,ed, integrated labor market 
information system that provides both labor 
market and caree. guidance information and that 
is located in schools, SDAs, county offices and 
other service agencies. Ohio is also using 8<7r 
funds to support school-to-work and dropout 
prevention programs and expects to issue grants 
this year for innovative youth programs and 
programs that will resuit in systematic 
interagency coordination of services. Other states 
are using 8% monies to fund projects providing 
collaborative dropout prevention services or other 
services for hard-to-serve youth. Since 87- 
funded activities are not counted in performance 
standards, many states use them for experimental 
activities or to support services to high risk 
populations. 

Critical Choices: RFP or Formula. One of 

the strategic choices that states have to make in 
using their 8 r / f funds is whether to issue the 
funds through a competitive grant process or a 
formula allocation. Each approach has its 
proponents, and each involves a number of 
important trade-offs. By u>ing an RFP or grant 
process, states have substantial control over the 
use of funds and can target monies to specific 
institutions or issues. A grant process also 
allows states to devote larger sums to specific 
projects that may have system-wide impact, such 
as model citywide dropout prevention initiatives 
or the development of pilot curriculum in one or 
two sites Formula allocations have the 
advantage of providing many localities with 
incentives for coordination or with funds for 
special projects, and offer SDAs an opportunity 
to address issues or develop programs of 
particular local concern. However, because 
formula allocations are spread in smaller 
amounts throughout the state are unlikely to 
leverage change beyond the individual SDA 

Focus on Change. Whatever the specific 
approach, 8% funds should be used in a way 
that creates new links between work and 
education and that leverages institutional change. 
As flexible, discretionary funds, they offer an 
opportunity that should not be wasted to move 
programs and systems in new directions. 
Whether using formulas or grants, states need to 
establish guidelines for 87r -funded projects that 
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make clear those high expectations, v. ah a focus 
on which agencies need to be involved in 
plannii g and Derations, what kinds of 
coordination » rc expected, what kinds of 
matching funds should be involved, who should 
be served, how the programs address the issues 
of educational enhancement, and expected 
outcomes. Though 8% funds are not subject to 
regular JTPA performance standards, states 
should negotiate clear performance expectation 
for any % c /c funded projects. Lastly, with the 
goal of building the results of any 8% efforts 
into the mainstream of JT p A, states need to ask 
what kinds of long-term institutional change will 
take place and how programs will continue after 
the 8% funding ex *es. 

Coordination Criteria: Sending a Message to 
the Field. As part of the Governor's JT n A 
Coordination and Special Services Plan, states 
are required to establish criteria for coordinating 
JTPA activities with program^ and services 
provided by education, public assistance, the 
employment services, rehabilitation agencies, and 
others. These coordination criteria can provide an 
effective vehicle for increasing coordination 
Coordination criteria, such as those in Michigan 
or Wisconsin, can require collaborative planning 
processes among youth- serving agencies or 
mandate the development of common tools and 
program strategies. Michigan's coordination 
criteria, for example, require each PIC to 
involve a core group of agencies in the 
development of a step-by-step plan ftr 
integrating service delivery. Among <he agencies 
required to be involved are second; '/ and post- 
secondary education, the Employment Service, 
the Department of Social Services, and 
community based organisations. Similarly, state 
criteria can be used to encourage co-lot ation or 
local decisions to channel funds through a single 
service delivery system. 

While are there few limits on the issues and 
behaviors that coordination requirements can 
address, they are likely to be effective only 
when they are d-weioped through an interagency 
process, identify specific actions ana measurable 
outcomes, and reflect state level agreements that 
are already in place. But states need to 
recognize that coordination criteria are more 
effective as message earners than as initiator.* of 
change. Where they are developed in isolation 
within tht JTPA system, coordination criteria arc 
unlikely to have a significant effect on 
institutional behavior. 



Coordinating Eligibility . As noted earlier, one 
of the biggest barriers to serving youth across 
agency lines and of mixing funds in a sii v 'e 
program is the difference in definitions 
eligibility among youth-serving systems. JTPA 
offers some flexibility in who can be served 
through the Title IIA's "10% Window" and the 
25% "window" associated with the 8% Education 
and Coordination Grants. Both of these windows 
allow JTPA programs to serve a limited number 
of non-economically disadvantaged clients. 
However, in many cases, JTPA programs are 
finding that these "windows" are not sufficient 
tv, allow easy movement of at-risk youth among 
programs or to encourage joint programming. 
The difficulties are especially evident in 
developing in-school programs, where schools 
may be unwilling to restrict program access to 
JTPA eligible youth, and in programs mixing 
8% funds, with one set of rules, and .egular IIA 
funds, which have another. 

A numbei of states have turned to the use of 
"family of one" policy as means of opening 
eligibility windows to facilitate coordination. 
Federal Regulations for JTPA (20 CFR 626.4) 
authorize Governors to define "family" when 
used in determining family income for eligibility. 
Under a family of one approach, the income of 
family members can be disregarded in consider- 
ing the eligibility of individual in < ertain 
targeted poonlations. Approximately one dozen 
states ha". .iOw adopted family of ^ r ' policies 
that define at-risk youth such as dropouts, poten- 
tial dropouts (e g. behind grade level, frequently 
absent, etc.). pregnant teenagers, and others as a 
family of one for eligibility purposes. 

A Controversial Approach, The use of family 
of one policy is the source of considerable 
controversy. Among practitioners, opponents 
question whether, given JTPA^ inability to 
serve more than a fraction of the eligible 
population, it is appropriate to open JTPA 
program eligibility to non-economically 
disadvantaged ■ Kiividuals. Others h'tve supported 
the use of family of one as a way of 
recognizing the importance of factors other than 
income in determining risk (e.g. basic skills 
deficits) for youth, but have argued that current 
policies open the door too wide by including 
other potentially at-risk populations. Finally, 
many supporters of the policy point to it as a 
critical tool in building coordination among 
systems. The use of family of one, they argue, 
is the only current means of allowing SDAs and 
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other agencies to form common definitions of at- 
risk youth and to translate those definitions into 
joint services. 

There is no clear answer here. The Depart- 
ment of Labor has indicated that it believes 
family of one policies are an inappropriate effort 
to circumvent the intent of JTPA and that they 
should not be used. However, DOL has not 
made any official policy determination at this 
point, and has recently indicated that it does not 
intend to. 

Evaluate the Impact. What is clear is that if 
family of one is used as a policy tool, it needs 
to be used with care. In writing their policies, 
states should have a clear purpose and rationale, 
and need to consider how to define eligible 
groups without abandoning JTPA's primary goal 
of serving economically disadvantaged. (Some 
states, for example, have set upper limits on 
family income for those eligible under family of 
one guidelines.) At the same time, if the 
policies are used, states should evaluate the 
effects of the policy on their service levels by 
tracking the proportion of young people >erved 
under family of one, their income level under 
standard JTPA rules, and the kinds of programs 
and services they are involved in. If the policy 
is not resulting in new collaborative services or 
is serving youth of substantial means, states may 
want to reconsider its use. 

Training and Collaboration. Lastly, one of 
the most effective means of facilitating coordin- 
ation is through a coherent program of technical 
assistance and information. States can use their 
6% technical assistance funds (as well as 8 r /r 
monies) to develop joint training programs or 
in formation -sharing mechanisms that build 
awareness and trust among practitioners in local 
and state agencies. Two examples stand out 

• In Wisconsin, state agencies have developed 
and run a joint training program on at-risk 
youth. Programs brought together interagency 
"teams'* from each SDA, including JTPA, 
education and human services representatives, to 
work on common definition and goals and to 
begin the development of collaborative youth 
strategies for their communities. The training has 
resulted in the identification of common interests 
among local youth administrators and 
development of new interagency planning groups 
in many of the SDAs. 

• In Michigan, state agencies have developed a 
directory of statewide, publicly-funded job 



training, education and related services as a 
means of acquainting service providers with 
available services. The state is mandating local 
systems to develop similar guides. By including 
information on the names of programs in the 
community, the types of services offered, 
eligibility requirements, who provides services, 
the scope of programs and contact persons, the 
guides will make it easier for local 
administrators and service providers to access a 
broader array of services. 

Conclusion 

While coordination clearly lies at the heart of 
improved services, it is a goal that cannot be 
achieved easily by policy action alone. There is 
nothing easy about sharing credit, power and 
money in an area often characterized by vague 
goals. Hard work, the ability to form 
relationships, political savvy, persistence, patience 
and luck all help. On one leve\ states and 
localities need to take the time to address a 
variety of legal and technical issues that can 
stand in the way of joint programming, such as 
protocols for sharing confidential information or 
development of simple release forms; 
development of common monitoring guidelines, 
funding cycles and reporting requirements, rules 
for co-mingling funds; and ways of measuring 
the contributions of several partners so that real 
inputs and outcomes can be evaluated. As one 
practitioner noted, "its the little things that get 
you down." 

At the same time, the clearest lesson to 
emerge from the Region V coordination 
experience is that successful collaboration can 
only result from making an effort to collaborate 
State and local leaders need to be willing to 
clarify joint objectives, invest in the effort to 
build trust, and stick with the process until a 
good working relationship is built. There is a 
real payoff for that effort, however, in terms of 
developing more effective services for youth. 



The complete version of "Wot king It Out" and 
its companion volume, "Working It Out Options 
Papers and Sample Policies" ate available 
through the Depaitment of Labor, Employment 
and Training Administration s ten Regional 
Offices (Boston, New York City, Philadelphia. 
Atlanta, Chicago, Kansas City, Dallas, Denver, 
San Francisco, and Seattle) DOL Regional 
Office addresses can be obtained from the 
Center for Human Resources at Brandeis 
University by calling (800) 343-4705 
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